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ABSTRACT 


The performance of an individual in a signal-detection task depends 
on two independent psychological processes. One of these processes is 
sensory activation, and the other is cognitive decision. In a signal- 
detection experiment, a subject must decide whether a Signal is present 
in a background of noise. When detection is not easy, the subject often 
shows bias. This thesis reports a signal-—detection experiment that was 
performed (a) to determine the reliability of estimated individual bias 
parameters in a number of sipnal-detection tasks and (b) to evaluate the 
usefulness of estimates of individual bias parameters Ree, one 
Signal-—detection task for predicting performance in other signal- 
detection tasks having different signal-to-noise ratios. The signal- 
detection tasks required identification of two upper-case letters of the 
alphabet presented for brief fixed-time intervals. The letters were F 
Fapiise) and E (signal plus noise). Nineteen subjects participated in 
the experiment. The results supported hypothesis (a) inasmuch as 
estimates of individual bias parameters tended to be reliable. Perfor- 
mance prediction from:one signal—detection task to another generally 
provided confirmation of hypothesis (b) as well. The support for 
neither hypothesis was very strong, however, and the thesis concludes 


with a number of suggestions for further research. 
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I. INTRODUCTION AND BACKGROUND 


fie vieoryon sienai—-devecvion was initially developed 
in the years 1952-1954 by Peterson, Birdsall, and Fox at 
the University of Michigan and by Van Meter and Middleton 
at the Massachusetts Institute of Technology. At the same 
time, Smith and Wilson (1953) at the Massachusetts Institute 
of Technology and Muson and Kartin (1956) at Bell Telephone 
Laboratories were conducting psychoacoustic experiments 
that demonstrated the relevance of the theory to human 
observers. Meanwhile, Tanner and Swets (1954) were making 
eeeporiial application of signal-detection theory to the field 
ou) vision. 

Pevemopment Of Siemal—detection theory has lead to a 
renewed interest in the possible processes involved in per- 
mioenon, psychophysics, and recognition memory. Recently, 
there has been a growing interest in various nOreoerarereic 
analyses of detection/recognition experiments. Generally, 
i application studies, the experimenter's concern is whether 
@ given performance change represents a change in sensory 
Gapacity or a change in a subject's (S's) criterion or 
response bias (Blough, 1957; Clark, 1966). 

The fundamental problem in signal-—-detection theory re- 
quires that one of two stimuli, noise (N) alone or signal 
plus noise (SN), be presented on each trial. The Ss are 


meguired to say ‘yes' if they perceive SN and 'no' if they 





Pome myouNwe Deveceion 15 difficult. After giving a 
Measponse, tne SS are given feedback as to the correct 
answer. 

lip Sy Cene@ves sanrvoccurrence of SN and So Genotes an 
emeurrence of N, then, by definition, P(S,) is the proba- 
Pela ty of a signal and P(S,) =] - P(S,). Let A, denote 


iL 
'yvyes' and A, denote TiC spicobabi lity of a hit (H), 
then, is P(H) = P(A,/S,); and the probability of a false 
merm (fF) is P(F) = P(A,/S5)- The following two-by-two 


performance matrix summarizes these definitions. 


A Ay 
55 eH) 1 - PCH) 
5 ICS), iP PGE) 
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mae basme theory of signal detection depends on two 
PmeecesSe€S: an activation process and a decision process. 
ihe activation process specifies the relation between exter- 
nal stimulus events and hypothesized sensory states of an S. 
mee cCecision process specifies the S's response in terms 
of his sensory state and the information that he has acquired 
ies the course of an experiment. 

According to the theory there exists a continuum of 
Mess ble observations, X, with two probability density 
murnet ions Ae ined ofc) alee eer) and f(x) (Swets, Tanner, 


eames Birdsall, 1961). Hach S establishes a criterion, Xa 





Deena TOttows this decision rule: if X ? XA. S makes 


an Ay response; if X < Xo S makes an A, response. 


P(x) 





Figure 1: Noise (N) and Signal-plus-Noise (SN) 
Probability Density Functions 


The S establishes the value of x, GOhewne Dasis of the 


fe) 
sn 
ikelihood ratio 8 = (see Figure 1). 
fx) 
Assuming thato_. = 0, = 0 assures Xo DELO ere) bhalale| bier 


Both tenes? and f(s) are assumed to be normal density 
functions, and d', defined as d' = <., mer COMemMGered to be 
Gaeesensitivity parameter, which describes the activation 
Meoecess. 6 1s considered to be the bias parameter, which 
describes the decision process. 

In addition to the studies done by Swets, Tanner, and 
Bardsall on the theory of signal-—detection, relevant work 
includes the treatment of signal detection as a three-state 
process by Atkinson, Bower, and Crothers (1965), and the 
Meenbirication of bias in signal detection with matching 


in probability learning by Legge and Thomas (1970). 





Maeisomem ewer, ald Crovhers not only reported considerable 
Peeradecwniee Ulrectly Contradictory to the assumption that 

every individual is an "ideal observer" (Swets, Tanner, and 
merasall , 1961) who maximizes Beered gain whenever he has 
femmeake a decision but also presented a formula for bias that 


maeludes an individual preference ratio, I. This formula is: 


B= pee PT 

Wien © = 1, according to this formula, matching occurs 
ence then B= P. | 

Nosteresponse—-pias models consider bias to remain constant 
imeem trial tO trigl. Static models with little or no empha- 
Sas On dynamic or learning effects have been traditional in 
meeenOpnysics, even though a response on one trial may be 
influenced by the stimuli, responses and outcomes of 
previous trials. These sequential effects have usually been 
meeevead aS experimental artifacts, to be eliminated by 
randomization, instructions, or the use of trained subjects. 

faking into Ree sUiit the learning process in a signal- 
detection task, Atkinson, Bower, and Crothers (1966) devel- 
oped the preceding formula for asymptotic bias (B), which 
appears in their three-state model in the following 


@ecision matrix: 





Pre-multiplication 


a & 
B 1—-B 
1 0 
0 al 


Ce eo eMawirl moy vine activation matrix 


26 aT 26: 
1-0 fo} 0 
1-0 @) O 


Mere 0 Stands for the sensitivity parameter, produces the 


performance matrix: 


electro “la ) (1=B) 


(l-o)B (1-co)(1-B) + o 


From the performance matrix, ihc POSSibLe TO relave 


bias to the proportion of hits P(H) and the proportion of 


false alarms P(F) in a signal-—detection task and thus 


obtain an estimate 


Qreowas. Bt. 


Panes the entry in the a row and A, Couunmemand fF Ur) 


Moweanad A] column: 


@’s the entry in the So 1 


P(H) (l-o) +o 5) 


P(F) = (1-o)B | (2) 


Using algebraic substitution and solving for o first 


from the P(F) and then from the P(H) equation yield: 


P(F) = (l1-o)B 


ee ew 


o> B 


and 


PCH) = (1-0)B + o 


5 P(H) - B 

1 - B 

Equating the two equations for o and solving for B lead 
Successively to the result: 


\ 


P(H) - B_ B - P(F) 


1 - B B 
pH) = (A=B)(B=P(F)) + B° 
B 
2 
p(H) = (4¢B)(B)-(1-B) (P(F)) + BU 


B 





Pere Glee) (P(r) ) 48° 
B = 


P(H) = 

pan) = Be(e-B)(P(F)) 

P(H)B = B-(1-B)P(F) 

Mabe ee lte (y)) == P(r) 
acho) meeek TEP (CH) ) =: PCE) 
BCP(H) - P(F)-1) = - PCF) 
—_ -P(F) 


PC) eae Er) = 


Or 


woere che prime on the last B shows that it is to be used as 


an estimator of bias. Similar development of Equations (1) 


and (2) produces the following relationships between P(H) 


Gk) 


o + P(F) 


pH) = 1 - (=BIEC) 


0 





These relationships describe the receiver-operating-charac- 
teristic (ROC) curves shown in Figures 2 and 3. The curves 
mmr eure ¢«¢ are 1SO-Sensiltivity curves, and curves in Figure 
3 are iso-bias curves. The subscripted letters in these 
Paszures indicate curves corresponding to different 


Sensitivities and biases. 


P(H) 


P(F) 


Pigure 2: Iso-sensitivity curves 


P(H) 


P(F) 


Pigure 3: Iso-bias curves 


se 





1S ep Galaie na yiay ae eal 


This experiment consisted of a two-response, visual- 
@eteculon task. Hach S observed from a distance of five 
i-eved Slide presentation of a Single letter, E or F, dis- 
played on a uniformly illuminated milk-white Plexiglas 
screen. S was told that the slides shown would be selected 
eurrandom from a total of 100. When a slide appeared, S 
had two seconds to respond, by means of a push button, to 
mia@aicactce which letter he thought appeared. With each 
Mesponse, © was given feedback by means of one of two lights, 
m@evane whether his choice was correct or incorrect. 5 
MeoecOlLd tO respond on each trial regardless of possible 
mmeervainty about which letter appeared. 

Lwiowmvomume FeSting period, there was a preliminary 
meee «lhis test was to determine whether the subject could 
perform above che probability of guessing. The criterion 
used permitted the experimenters to be sure with 97.5 per 
cent confidence that S was above the threshold of completely 
m@manee responding. A proportion of choices two standard 
deviations above the mean was required for S to achieve 
Meee ricverion. For example, if fifty trials were given, 

S would have to give at least 31 correct responses. If 
he did not, the experimenter would adjust the shutter speed 
till S fulfilled the requirement. 

Testing proper consisted of 400 trials which took a 


total of about 50 minutes, including a 60-second rest period 


12 


wate seooMomvOours0 britals, Except for the preliminary 
mest, when the shutter speed was adjusted to achieve the 
Griterion described above, the shutter speed remained 
femenant throughout the experiment. | 

Mhe visual display was an area six inches square, in 
ma@ewcenter of which one of the upper-case letters, E or F, 
memid appear. The size of the letter remained Semeesiat 
mommeuenout. The experimenters attempted to make the size 
of the letter equivalent to a 20/20-vision letter on the 
pi@ewren chart. However, visual acuity for the shutter 
aeoeesmuocad required thay the fetter be seven millimeters 
Peaeietor Viewing at a distance of five feet. This is 
equivalent to a 20/40-vision letter on the Snellen chart. 

=> responded to the visual display by pressing one of 
two buttons set six inches apart on a board that he could 
femsto tO a comfortable position. Punched paper tapes 
controlled the sequence of letters. The responses were 
recorded on counters which were electrically wired to a 
meemmsvoscope. After the preliminary testing, all responses 
P—accoOracd (Or eCach Subject, in the four categories: 


E/E, F/F, E/F, and F/E. 


Hae, SUBJECTS 

The subjects were thirteen military-officer graduate 
maueents av the Naval Postgraduate School. Their participa- 
TLOn in the experiment required one hour of free time 


between scheduled classes. None had served in previous 


13 





Signal-detection studies. Each stated he had 20/20 vision 


memvi1sion corrected to 20/20. 


Eee FE ROCE DURE 
Each S was seated in‘’the environmental chamber and 
mecer1ved identical instructions explaining the nature of 


the task. These were the instructions: 


ims 15 a2 Signal—-detection task. You will observe on a 
view screen two upper case letters, an E and an F. Upon 
Zonas, respond by pushing the Left-nand button. 
Meo seeing an F, respond by pushing the right-hand 
M@uGOn. Ou must respond on each trial regardless of 
possible uncertainty about which letter appeared. 

Meet YOU push the button of your choice, push it once 
pocmonly onee. Do not push the buttons prior to a 
presentation, only after a slide has appeared. You 

will have two seconds after the presentation to respond. 
me our field of vision, a set of lights will indicate 
Tiemacte your response was correct or incorrect: green 
MemcmeOrrees response; red for an incorrect one. A 
light will appear immediately upon your response. If, 
for example, an E is presented and you select an E, a 
green light will appear. If you select the F and an & 
mewaculally presented, a red light will appear. There 
fee be three 100 trials presented during the testing 
@eritod. They will be divided into sets of 50 trials with 
a one minute rest period after each set. Prior to the 
Zinio vermrod., you wlll receive 50 to 100 trials to 
acquaint you with the apparatus and procedures. A 
pele trial wili consist of the following time sequence: 
slide presentation; response time (2.0 seconds); random 
mide Sell@crion and machine cycling (3.2 seconds): 
followed by next presentation. Inter-~-communications are 
meoysaed for any questions you may have during testing. 
pound deadening earphones are to be worn in order to 
MeevcnivenOlse distraction. When your eyes become 

Night adapted, the testing cycle will start. You will 
be informed that the testing cycle will commence in 

mwo seconds. <A presentation will then follow until a 
Peaeol oO trials is completed, upon which you will be 
informed of a one-minute rest period. Are there any 
questions? 


14 





Paver reocel!vIngs the instructions, S put on the sound- 
deadening earphones, the environmental chamber door was 
muescdsmame tires minutes were provided to allow 5 to 
become night-adapted and to test the inter~communication 
eae lune predaminary test, consisting of 50 to 100 
meets, followed, and then the main testing began and 


Mercainued for 300 trials. 


ee APPARATUS 

In designing the apparatus for the experiment, the 
Sencept of no human interference was of prime concern. 
imme entire testing procedure was accomplished electro- 
Mmecmanically, thus eliminating any human eiewer, OF bieseot 
mo@eeecxperimenter. The apparatus consisted of five major 
components: (1) projection chamber; (2) viewing chamber; 
(3) tachistoscope; (4) environmental chamber; and (5) 
Seservation center. 

Eaojectvton ‘chamber. 

The projection chamber was a six-foot aluminum chute, 
opened at one end. It was designed by the experimenters 
and constructed Povo lava l Posteraduatc sochool Machine 
shop using one-sixteenth inch aluminum sheeting. The inside 
feroepaintved flat black to absorb any light scattering and 
prevent reflection. The chamber housed a Kodak Ektagraphic 
RA-960 slide projector. At the opened end of the chute 
were mounted four light indicators (two green, two red) 


Mereteedback; the green lights indicated a hit or correct 


1S: 





Pejyecuuons(i:/% or F/F), and the red lights indicated a 
miss or false alarm (F/E or E/F). 

Viewing chamber 

The viewing chamber was a five-foot aluminum chute, 
opened at both ends. This too was designed by the experi- 
menters and constructed by the Naval Postgraduate School 
Machine Shop using one sixteenth inch aluminum sheeting. 
It was painted flat black for the Same reason as the pro- 
jection chamber. Attached to the viewing chamber were two 
pushbuttons which permitted S to make noise (F) and signal- 
plus-noise (E) responses respectively. 

Tachistoscope 

The random-access projection tachistoscope system was 
Gesigned by the Lafayette Instrument Company. This system 
incorporates three standard components mounted in a common 
2l-inch relay rack and inter-connected to provide tachisto- 
scopic projection with complete random-access ability. 
(a) The 52023 timer allowed for repeat cycling and auto- 
matic system operation. (b) The 43016 (VS1-E, tape) 
Bavided eG pepulse GOoevne shutter for exposures from 
Se ReomowemceconGies(c¢) The Digitronic, Inc.w, tape 
reader allowed for random access to the projector carosel. 
ies teavure made possible random selection of slides by 
use of the binary - binary-nine system, permitting the 
presentation of random sequences and varying percentages 


See che B's and F's. 
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PMevaemed yO une Gachwsvoscope were four response counters. 
menleur COouUNLers Kept a running account of hits, misses, 
merrece rejyecoions, and false alarms. Appendix F is a 
wiring diagram of this circuit, which was made compatible 
mermchne Lafayette tachistoscope. Also connected to the 
eachistoscope were four podtense-Teedback Hh ales) clic atjalelauie shove patsye 
Immediately upon response, these indicators would inform S 
Meewner his choice was correct or incorrect. Green 
mmacaved correct, and red, incorrect. 

Environmental chamber 

The experimenters felt that the conditions of testing 
were adequate and well-controlled. To assure that the 
results of the tests would be meaningful and useful, it 
Mmmemconsigered necessary to control lighting, atmospheric 
Meme vcristacs, distracting noises, and working facilities. 
mae environmental chamber provided optimal control Gl =Gacsce 
Mmemeatvions. in addition, it contained the viewing chamber, 
the communication system between observer and experimenter, 
eacea Milk-white Plexiglas screen. 

Secor varrom cOoncrol center 

The observation control center provided a facility for 
Hemervoring of the equipment, S's responses, and inter- 
emnunications. In addition, it allowed for control of 
maemecnvironmental conditions throughout testing. 

Through the use of an Ektagraphic copier and 304 insta- 
matic camera, the 126-millimeter slides used in the experiment 


were made by photographing black upper-case E's and F's on 


If 





peimoesbacKkpround. Careful attention to slide mounting 
ena centering insured consistent positioning of each letter 
somerne presentation. 

Rie program whiea produced the stimulus punch tape 
was written in baSic programming language and executed on 
the Digital PDP-8 Lab E computer. It was a general program. 
Pam vacpitocran., Lhe experimenters set the percentages 
eee and &f controlling digits to be punched. 

The Digital machine punches in ASCII (American Standard 
Computer Code) while the Digitronic, Inc., punch-paper-—tape 
reader reads in binary - binary-nine code. Another program 
was thus used to transform the ASCII code to binary - 
binary-nine by using the CDC-160 computer tape reader and 


Pench. 
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Pi. s EXPERIMENT TT 


Uigtescxpersment Was the same as Experiment I, with one 
Eeecepuion: the shutter speed remained constant at 250 
peeli-seconds while the size of the upper case letters E 
emo F varied from four mm. to six mm. in the preliminary 
test in order to make sure that the subject was above the 
threshold of completely chance responding. The remainder 
of the experiment proceeded exactly as Experiment I, with 
the shutter speed fixed at 250 milli-seconds and the letter 


Size as determined in the preliminary test. 


t 


fe OUBJECTS 

mone subTeCcosS were Six military-officer praduate students 
memeene Naval Postgraduate School. Their participation in 
bas experiment required one hour of free time between 
scheduled classes. None had served in previous- signal- 
detection studies. Each stated he had 20/20 vision or 


mreron corrected to 20/20. 


B. PROCEDURE 

The procedure was the same as it was in Experiment I. 
Pmeectvask was made difficult because of the size rather than 
mer duration of the stimulus. For an S with 20/20 vision, 
the size of the stimulus (E or F) was thus equivalent to 
the size of a letter on a line below the 20/20 line on the 
snellen chart. The actual size of the stimulus, of course, 


depended on its distance (five feet) from S. 


IY 





iV eee Ke OULTS 


fv FILOT STUDY 

irr steaurempe eau conducting the experiment gave the 
Eeperimenters insight into an important factor which had 
been previously overlooked. The first seven Ss were given 
Beer trials with a total running time of 75 minutes. Bias 
Prediction was inaccurate, and graphing the Ss' sensitivity 
Ssmowed in general that sensitivity declined significantly 
as the experiment progressed. From this data, it was con- 
eeeeded that Ss were showing VaIcheucucottees Oleiatifue. Lo 
eliminate this problem the number of trials was decreased 
miema lonper rest period was given following each set of 


meals. 


Pens sULTS OF EXPERIMENTS 

A summary of the results appears in Remencdices /:\iee oe 
emaeC. In Appendix Ae Bo is the calculated bias of S for 
a signal-to-noise toeme on 50759. B. is the estimator of 


2 
bias for a signal-to-noise ratio of 40/60. B.-Bo is the 
Smeererence in the prediction of bias showing whether the 
Meeatction Over~or under-shot the predicted values. I is 
Maes individual preference ratio, showing that, when I > l, 
S prefers noise (F) and, when I < 1, S prefers signal plus 


noise (E). ‘The same notation applies in Appendix B and 


Appendix C. 
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CoV emen deta Olrcos if) Appendices A, B, and C 
meows that the best Ss, those having -.05 < B.-B, ee wilad 
merelues that were relatively constant. This indicates 
that these Ss had reached the asymptotic-performance level 
which, according to Atkinson, Bower, and Crothers (1965), 
mea prerequisite for their use of the bias-prediction 
mormula. ithe first seven Ss had not reached this 
aoeymptotic-performance level. 

MHnewnOC curves in Appendix D show that the sensitivity 
marameter for almost all Ss decreased near the completion 
Beene LeSting. This indicates that fatigue was again a 
factor which could not be eliminated in these experiments. 

A nested-factorial analysis of the individual preference 
ratios (I) computed from the data shown in Appendices A, B, 
em@aec was performed separately for Experiments I and II, and 
m@eetresvuilts appear in Appendix E. In both experiments, the 
memerability of data proved to be insignificant: F(6,12) = 
1.660, Eeoee>. for Experiment T, and F(5,10) = 2.694, | 
meee, [Or Experiment Tl. The implication of these 
Meeults 1s that differences among individuals showed no 
preater variation than differences within individuals from 


ewe signal-to-noise ratio to another. 


el 





V. DISCUSSION 


The results of these experiments provided little evidence 
meevne reliability of estimated individual bias parameters. 
As to the usefulness of estimates of individual bias param- 
eters obtained in one signal-detection task for predicting 
Mert ormance in other signal-detection tasks having different 
Signal-to-noise ratios, both experiments generally provided 
confirmation. 

Letter recognition is a complex problem. While one 
can draw an analogy between detection experiments using white 
Mmemese With auditory Signals and this study using the letter 
Pee Ol sSeChmue is DOSSibDle that the letter Y does nov 
meve the Same effect in visual stimulation as does white 
noise in auditory stimulation. Neisser (1967) and Posner 
(1969) point out the complexities of letter-processing. 

J. E. Smith (1972), moreover, reported that estimated 
response bias in signal-detection tasks are highly dependent 
upon the particular model used to obtain the estimate. 

Ip alts eee wmoemove that all Ss had a peeaer ence 
maci10 . > 1.0. This means that all Ss had a preference of 
Emoosiang more noise, F, than signal plus noise, E. ‘Two 
possibilities exist to explain this phenomenon. The first 
Messibility is that S was looking for an E presentation 
because of E's position in the alphabet. When he did not 


feenon © Or was in doubt, S responded with an F. The 


Ze 





Peeomo rs Unat >, when in doubt, tended to pick the simpler 
F. 

(iamioemneseatrch am thas avea could be accomplished by 
meme Tor moise and R for signal plus noise, or O for 
Momee and @ for signal plus noise. If the assumption is 
Weta aS tO alphabetical order, the S now would be looking 
momar Or O and, when he does not see it, will respond 
froma R or @. This would result in a performance ratio 
oie < 1.0. 

Mo OOCain Svuable data, better results, as well as to 
Seemnate fatigue of the Ss, fewer Ss perhaps should be 
Meeaned but Gach S should be required to participate in 
more periods of testing. These periods of testing would 
BemenOorver ian duration, thus eliminating fatigue and 
therefore providing more stable data and better results. 

iopciaimimape vne faceuvor Of autokinesis or eye strain, 
eerang ee SpeulcGmene WihkeGerOo the Gachistoscope. 
ities would be connected to sound earphones, thereby providing 
the Ss with a warning of the next slide presentation. This 
would allow the S to be prepared and ready, while relieving 
meemeseorain and the tendency to blink during a stimulus 
Peeecentation. 

fo climamave eye dilation and irritation due to the 
Pee projector flash, a uniformly 1it apktis screen could 
be used. This would help keep pupil dilation and eye 


meer caction to a minimum. 
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APPENDIX A: BIAS PARAMETERS 


(50750 to 40/60) 


Ss By B., B, (B2-B,) I 
01 es ---- ---- ----~ — 
02 ---- ---- ---- ----~ ——— 
03 ---- ---- ---- ---- -~-- 
OY = =a one ———— ere 
05 204 .099 SEES .130 3.889 
06 .250 pileea LEAL ~.040 3.000 
07 .097 .067 .153 . 086 9.333 
08 . 326 243 N26, 024 Ze Cial 
09 .250 .182 .175 mae w 3.000 
ine 523i alazall Ses 045 3.222 
“Lal .194 .139 2154 .015 4.143 
ib2 Blow 8 .163 045 5.000 
13 da! eS .200 046 Bu les 
14 5 BIOS ey pale 35 -.012 S205 
15 .298 5 221 .280 .059 AS S| 
16 .143 mnCle PG 046 6.000 
17 .200 pallls BLS 033 4,000 
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